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ABSTRACT 

The evaluation of a one-week training course for 
position classification trainees and personnel specialists is 
described. The study population included 29 Government employees in 
grades 5 through 9, 14 of whom were position classification trainees 
and 15 of whom were interns or personnel specialists. The evaluation 
study outline was as follows; A. Course selected for evaluation; B. 
Learners pre-assessed by assumptions by the Personnel Management 
Training Center staff and by analysis of participants* present job 
responsibilities; C. Course objectives stated in terms that are 
behavioral, observable, and measurable; D. Evaluation instruments 
established; E. Course designed; F. Course conducted and evaluation 
data gathered; G. Evaluation data analyzed; H. Conclusions formed 
from evaluation data; I. Recommendation made for course redesign; and 
J. Evaluation model redesigned. The course selected for study was 
"Position Classification and the Management Process." A summary Chart 
presents objectives, methods of observation, and acceptable level of 
performance . Ten attachments provide the evaluation instruments; 
these are 1. 50-item objective pre-test; 2. 50-item objective 
post- test; (attachment 3 is a test-item distribution chart for both 
the pre— and post- test) ; 4. Learner self-assessment questionnaire and 
Supervisor assessment questionnaire; 5. Training work product rating 
scale; 6. Student work sheet for evaluation of positions; 7. 

Checklist for desk audit; 8. Evaluation of specific content items; 9. 
Evaluation of resources, methods, and materials; 10. Evaluation of 
instructor; and 11. Evaluation of environmental features. (DB) 
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I. TITLE 

An evaluation model designed to measure the effectiveness of 
a one-week training course, "Position Classification and the 
Management Process." 

II. OUTLINE OF THE STUDY 

A. Course selected for evaluation 

B. Learners pre-assessed by: 

1. Assumptions by the Personnel Management Training Center 
staff 

2. Analysis of participants' present job responsibilities 

C. Course objectives stated in terms that are: 

1. Behavioral 

2. Observable 

3. Measurable 

D. Evaluation instruments established 

E. Course designed 

F. Course conducted and evaluation data gathered 

G. Evaluation data analyzed 

H. Conclusions formed from evaluation data 
X. Recommendation made for course redesign 
J. Evaluation model redesigned 

III. COURSE SELECTED FOR STUDY 

"Position Classification and the Management Process" conducted 
March 2 through 6, 1970. In addition, the evaluation model will 
be applied to the June 22 through 26, 1970 session. 
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IV. LEARNER PRE-ASSESSED 



A. Assumptions fay the Personnel Ma n agem en t Training Center staff 

1. Employees will be involved in position classification or 
related personnel work with one year or less of technical 
experience 

2. Majority will be in grades 5 through 9 

3. Majority will be recent college graduates with a wide 
variety of collage majors 

4. Most will have passed the Federal Service Entrance 
Examination which is a general learning ability test 
that includes measures of 

a. Ability to understand and use written language, and 

b. Ability to understand, interpret, and solve problems 
presented in quantitative terms 

B. Analysis of participants* job responsibilities 

The actual population in the study includes a total of 29 
participants at the grades 5 through 9 level. Fourteen of 
the participants are position classification trainees, who 
will apply the learned skills and knowledges directly to 
their present jobs. The remaining 15 participants are being 
cross-trained and the course is considered developmental. 

This group consists of interne or personnel specialists in 
other functional areas of personnel, e.g., staffing or 
employee-management relations. The skills and knowledges 
acquired in this course by the latter group will be applied 
indirectly to their present jobs. The evaluation data is 
reported and aiMl^ed~T6r~b6 th groups. The position classification 
trainees will be referred to as the "training group," and the 
group that was in the course for developmental purposes will be 
referred to as the "developmental group." 

V. COURSE OBJECTIVES 

A. Each learner will be able to demonstrate understanding of the 
following fundamentals of position classification s 

1 . Terminology 

2. Basic legislation 

3. Structure of the system 

4. Methodology, techniques, and procedures 

5. General policy and philosophy of the system 

6. Trends in the field 

7. Principles 




B. Using the above knowledge, the learner will be able to 
demonstrate skill in the following* 

8. Desk audit 

9. Analysis of position classification standards 

10. Analysis * * job information 

11. Evaluation of positions 

12. Writing position descriptions 

13. Writing evaluation statements 

14. Dealing effectively with line officials and employees 

C. The learner will be able to demonstrate an understanding of the 
following fundamentals of the wage system : 

15. Terminology 

16. Basic authority 

17. Structure of the system 

18. General policy and philosophy of the system 

D. Using the above knowledge, the learner will be able to 
demonstrate skill in the following area of the wage system : 

19. Evaluation of positions 

E. The learner will be able to demonstrate an understanding of 
the following fundamentals of position management : 



20. General policy and philosophy of the system 

21. Basic authority 

22. Principles \ 

NOTE: Thg chart on the following pages indicates how these objectives 

will be observed and the acceptable level of* performance. 
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SUMMARY CHART: Objectives, methods of observation, 

and acceptable level of performance 



TERMINAL BEHAVIOR 

> 



ATTACH- 

HOW OBSERVED MENT 



A. Learner will be able to Pre-test 1 

demonstrate an understanding 

of the following fundamentals Post- test 2 

of position classification: 



1 . Terminology 

2. Basic legislation 

3. Structure of the system 

4. Methodology, techniques, 
and procedures 

5* General policy and 

philosophy of the system 

6. Trends in the field 

7 . Principles 



Post-assessment 
by learner 

Post -assessment 
by supervisor 



B. Using the above knowledge the 
learner will be able to 
demonstrate skill in the 
following: 



4 

4 



8. Desk audit Observation by peers 7 

using checklist 

Observation by staff 7 
using checklist 

Post-assessment by 4 
learner 



Post-assessment by 4 
supervisor 



9. Analysis of position 

classification standards 



Training work product 5 
Assessment by learner 4 



Assessment by super- 4 
visor 
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ACCEPTABLE LEVEL 
OF PERFORMANCE 

90% on post- test 



Average rating 
of 3.0 

Average rating 
of 3.0 



Rated against 
school solution 
average rating of 
3.0 



10. 


Analysis of Job 


Training work product 


5 


Rated against 




information 


Assessment by learner 


4 


school solution 
average rating of 
3.0 






Assessment by super- 
visor 


4 




11. 


Evaluation of positions 


Training work product 


5-6 


Rated against 
school solution 






Assessment by learner 


4 


average rating of 
3.0 






Assessment by super- 
visor 


4 




12. 


Writing position 


Training work product 


5 


Rated against 




description 


Assessment by learner 


4 


school solution 
average rating of 
3.0 






Assessment by super- 
visor 


4 




13. 


Writing of evaluation 


Training work product 


5 


Rated against 




statements 


Assessment by learner 


4 


school solution 
average rating of 
3.0 






Assessment by super- 
visor 


4 




14. 


Dealing effectively 
with line officials and 


Assessment by learner 


4 






employees 


Assessment by super- 
visor 


4 




Learner will be able to 
demonstrate an understanding 








of 


the following fundamentals 








of 


the wa^se system: 








15. 


Terminology 


Pre-test 


1 


90% on post- test 


16. 


Basic authority 


Post-test 


2 




17. 


Structure of the system 








18. 


General policy and 


Assessment by learner 


4 






philosophy of the system 


Assessment by super- 


4 





visor 



D. Using the above knowledge 
the learner will be able 
to demonstrate skill in 
the following area of the 
wage system : 

19* Evaluation of positions Training work product 5 Rated against 

school solution 

Assessment by learner A average rating of 

3*0 

Assessment by super- 4 
visor 

E. Learner will be able to 
demonstrate an understanding 
of the following fundamentals 



of nosition management: 




20. 


General policy and 
philosophy of the system 


Pre-test 1 & 2 90% on post-test 


21. 


Basic authority 


Post-test 


22. 


Principles 


Training work product Average rating 

of 3.0 

Assessment by learner 






Assessment by supervisor 





EVALUATION INSTRUMENTS ESTABLISHED 



The following evaluation instruments will be used: 

A. 50-item objective pre-test (Attachment 1) 

B. 50-item objective post-test (Attachment 2) 

Attachment 3 is' a test item distribution chart for both 
the pre-test and post- test. 

C. Learner self-assessment questionnaire (Attachment 4) 

D. Supervisor assessment questionnaire 

This will be the same as attachment 4 with modified 
instructions to the supervisor. 

E. Training work product rating scale (Attachment 5) 

F. Student work sheet for evaluation of positions (Attachment 6) 

G. Checklist for desk audit (Attachment 7) 

In addition to the above, several other aspects of the program 
will be evaluated by use of the following: 

H. Evaluation of specific content items (Attachment 8) 

I. Evaluation of resources, methods, and materials (Attachment 9) 

J. Evaluation of instructor or discussion leader (Attachment 10) 

K. Evaluation of environmental features (Attachment 11) 



POSITION CLASSIFICATION AND THE MANAGEMENT PROCESS 



EXAMINATION 



Questions l through 33 - indicate True or False , as appropriate, on the 
answer sheet . 

Questions 34 through SO - multiple choice - put the letter of the best 
answer on the answer sheet. 



1. A position consists of the duties and responsibilities assigned to 
one employee. 

2. "Series" means the same kind of work and level of difficulty. 

3. An "occupational group" embraces several unrelated occupations, 
professions, or activities. 

4. The Classification Act of 1949, as amended, provides a plan for the 
classification of positions under which there shall be equal pay for 
substantially equal work and positions shall be placed in classes and 
grades according to duties and responsibilities. 

5. Each agency has the primary responsibility for assuring that all 
its positions GS-1 to GS-18 are correctly classified. 

6. Position descriptions and classification standards are similar 
classification tools, used for similar purposes. 

7. In a mixed series position, always put the portion in the series of 
the grade controlling duties. 

8. Organizational and occupational are two types of position classification 
surveys . 

9. Typing, voucher examining, and developmental testing are examples of 
responsibilities. 

10. The principle that Federal pay should be comparable with private 
enterprise is a Federal salary policy. 

11. The position classification standards which have been issued follow a 
single format pattern. 
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12. Point rating classification systems require less use o£ j udgemen t 
by the classifier than other systems. 

13. The major rigidity in the Classification Act is the inflexible pay 
system which is presently in effect. 

closing an interview* the classifier should summarize his impressions 
as to the proper classification of the position. 

15. The volume of personal contacts in a position is not in itself of major 
significance. 

16. The base of any classification system depends on its purpose and use. 

17. A new position description is required whenever there is any change 
in the duties assigned to a position. 

18. The number of persons supervised is the primary factor to be considered 
in the classification of supervisory positions. 

19. The Commission may audit positions in an agency or department only with 
the advice and consent of the head of that agency or department. 

20. The occurrence of several types of tasks in any given position always 
increases the difficulty of the work of the position. 

21. A position* involving for 15% of the time, work in reporting stenography 
(GS-312-5) and 85% in determining freight rates (GS- 213 1-5) would be 6 lass if led 
in the GS-2131-0 series. 

22. Your agency has the primary responsibility for assuring that all its 
positions GS-1 to GS-15 are correctly classified. 

23. New position classification standards tend to avoid use of the “point 
system. " 

24. The basic concepts of the position classification system in the Federal 
service will never change. 

25. The trend in position classification standards is toward more specific 
standards which help reduce the gray area of “judgement." 

Coordinated Federal Wage System was established by the Classification 
Act of 1949* as amended. 
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27. The 39 key ranking jobs in the Coordinated Federal Wage System are 
descriptions of commonly found kinds of nonsupervisory work in the Federal 
government . 

28. The Civil Service Commission is responsible for developing and issuing 
basic policies and procedures for the Coordinated Federal Wage System. 

29. In the Coordinated Federal Wage System, the Civil Service Commission 

standards prescribes how agencies should organize work and the contents of 
jobs. 



30. Position management is the same as position classification. 

31. Congress has established the criteria for the operation of an effective 
position management system. 

32. Position classifiers have the major responsibility of implementing a 
position management program. 

33. Position management is concerned with the impact that job design has on 
employee morale and attitudes. 

* i 

34. Major duties are those duties which: 

a. occupy more than 10% of the time of the incumbent. 

b. are the reason for the position's existence and eovern its 
qualification requirements. 

c. are performed in a continuous, uninterrupted manner. 

d. are presently being performed and not projected duties. 

35. Positions whose duties are characterized by the application of basic 
or natural law, principles or theory, are considered: 

a. interdisciplinary positions. 

b. physical science positions. 

c. professional positions. 

d. research positions. 

36. A supposed or implied relationship between the duties of one position 
and those of another in a lower grade is called: 

a. organizational parallelism. 

b. grade attraction. 

c. "full assistant" concept. 

d. impact of man on job. 

1 
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37. Classes are determined by: 

a. gradual subdivision into services or schedules, occupational groups, 
series, and finally, classes. 

b. gradual subdivision into occupational groups, series, classes, and 
finally, services or schedules. 

c. gradual subdivision into services, occupational groups, series, and 
finally, title and grade. 

d. gradual subdivision into services or schedules, grades, series, and 
finally, classes. 

38. The formal structure of the Federal position classification plan, defining 
a basic compensation schedule with 18 grades, has been established by: 

a. Civil Service Commission. 

b . Congress . 

c. Interagency Advisory Group. 

d . Executive Order . 

39. Which one of the following is not considered one of the eight basic 
factors in position classification standards? 

a. nature and variety of work. 

b. originality required. 

c. nature of available guidelines for performance of work. 

d. individual stature in the profession. 

40. In classifying a position, the first step is: 

a. determine if there are published standards. 

b. determine if the position is under the Classification Act. 

c. determine the series. 

d. determine the grade. 

41. A position involves the following combination of work: 10% office 

machine operating, GS-350-2; 15% stenography, GS-312-4; 25% general office 
clerical, GS-301-4; and 50% procurement clerical, GS-2020-5. Its proper 
classification is: 

a. Clerk* Stenographer, GS-312-4. 

b. Clerk (Stenography), GS-301-4. 

c. Procurement Clerk (Stenography), GS-2020-4. 

d. Procurement Clerk (Stenography), GS-2020-5. 

42. A part-time position is classified to the same class as: 

a. other part-time positions in the same organizational unit. 

b. full-time positions with similar duties and responsibilities. 

c. other part-time positions established for the same length of time. 

d. other permanent part-time positions. 
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43. Two methods for listing order of duties on a position description are 
the: 

a. primary and secondary methods. 

b. ranking and point methods. 

c. sequence and random methods. 

d. major duty and minor duty methods. 

* 

44. The three primary sources of facts about positions for classification 
purposes are: 

a. the position description* mission statements* and the supervisor. 

b. the incumbent* supervisor* and work samples. 

c. the organizational chart* position description* and desk audit. 

d. the desk audit* shop talk* and position description files. 

45. Position classification is useful in which of the following management 
processes: 

a. budgeting. 

b. reduction in force. 

c. performance rating. 

d. all of the above. 

46. When conducting a position audit the classifier finds the employee is 
performing work not included in this position description nor assigned by 
his supervisor. The classifier should: 

a. Ignore such duties in evaluating and classifying the position. 

b. credit such duties in reaching a classification determination. 

c. reach a mutual understanding with supervisor and employee* causing 
such duties to be eliminated or officially recognized in the position. 

d. suggest to the employee that he discontinue performing such duties. 

47. A duty which occupies less than 10% of an employee's time and which 
establishes a unique qualifications requirement 

a. is considered a minor incidental duty in evaluating the position. 

b. need not be included in the position description. 

c. usually indicates an' attempt by the supervisor to foster up-grading 
of his position and should be reported to management. 

d. merits consideration in determining the class in which the position 
will be placed. 

position description should always reflect: 

the duties assigned the employee upon being assigned the position, 
the most logical group of duties for efficient operations, 
the qualifications possessed by the current incumbent which assure 
the level of performance necessary for the current classification, 
the duties and responsibilities currently required of the incumbent. 



48. The 

a. 

b. 

c. 

d. 
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Coordinated Federal Wage System, the following four factors are 
used in grading nonsupervisory jobs: 

a. skill and knowledge, responsibility, physical effort, nature and 
variety of work. 

b. personal contacts, responsibilities, working conditions, physical 
efforts. 

c. working conditions, physical efforts, responsibilities, skill and 
knowledge. 

d. skill and knowledge, qualifications, physical effort, working 

conditions. * 

50. Position management is: 

a. the process by which we select a title and code for a group of duties 
that constitute an established position. 

b. the process by which decisions are made as to what duties, will be 
incorporated into a position. 

c. the same thing as position classification. 

d. primarily a position control system. 
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Attachment 2 



POSITION CLASSIFICATION AND THE MANAGEMENT PROCESS 
EXAMINATION 



Questions l through 33 - indicate True or False, as appropriate, on the 
answer sheet . 

Questions 34 through 50 - multiple choice - put the letter of the best 
answer on the answer sheet. 



1. The terms "grade” and "class” mean the same thing. 

2. If two positions are placed in the same class, they are automatically 
in the same grade. 

3. The three -part code assigned to the occupational structure has a symbol 
for the schedule, series, and grade. 

4. The Classification Act of 1949, as amended, covers all white collar 
government employees in the Executive Branch. 

5. The Civil Service Commission may at its discretion create additional 
grades under the Federal classification plan. 

6. When applicable position classification standards issues by the Civil 
Service Commission exist for a position, they must be used as the governing 
criteria of that position. 

7. In a mixed grade position, 25% of an employee's time is an illustration 
of what is meant by a duty that occupies a substantial part of the time. 

8. The most useful and perhaps most difficult fact-finding technique in 
classification is the audit. 

9. Meeting deadlines and seeing that adequate stocks are maintained are 
examples of responsibilities. 

10. Grade and pay mean the same thing. 

11. The position classification standards issued by the Civil Service 
Commission establish a uniform job evaluation system for all occupations. 

12. The value of the Federal classification plan rests heavily on the 
classifier's use of judgement. 
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13. The equal pay for equal work concept contradicts the comparability 
pay principle. 

14. A position audit is a good means of acquainting the classifier with a 
new occupational field. 

15. The most important thing to consider under the classification factor* 
"Personal Relationships*" is with whom the contacts are made. 

16. In order to assure that the principle of equal pay for substantially 
equal work is maintained* all jobs must be evaluated against the same 
classification factors. 

17 . A standard position description may be used to describe similar positions 
found in a number of different organizational segments and classifiable in 
the same title* series* and grade. 

18. The factor pattern is not appropriate for use in analyzing and evaluating 
positions for which no standards have been published. 

19. Under the Classification Act of 1949* an appeal of a position to the 
Civil Service Commission may be made only by the employee concerned. 

20. Whenever Incumbents of one-of-a-kind positions change, it is wise to 
review such jobs to determine whether the scope of the assignment, delegations 
of authority* etc.* will remain the same. 

21. A person spending 45% of his time examining vouchers (GS-540-4), 15% 
typing reports and statistical tables (GS-322-3)* and 40% of his time on 
varied clerical work (CS -301-3) would be classified as Clerk-Typist* GS-322-4. 

22. If you have assurance that management has delegated certain duties to an 
occupied position* it should be classified on the basis of those duties* even 
though the incumbent is not performing them. 

23. The "point system" of evaluation is found in several position classification 
standards. 

24. The basic concepts of the position classification system will be reviewed 
over the next several years. 

25. The trend in position classification standards is toward more general 
standards which can be used for several occupational groups. 
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26. The Coordinated Federal Wage System was established by Presidential 
memorandum to the heads of executive departments and agencies. 

27. Thirty-nine key ranking jobs provide the framework of the 15-grade 
nonsupervisory structure of the Coordinated Federal Wage System. 

28. The head of each executive department or agency is responsible within 
policies and practices of the Coordinated Federal Wage System for fixing 
and administering rates of pay for wage employees of his organisation. 

29. In the Coordinated Federal Wage System, the position description, to 
the extent possible, should present the relevant factor information in the 
same order and sequence as found in the applicable grading standard. 

30. Position control is part of position management. 

31. Bureau of the Budget Circular No. A-64 established criteria for the 
operation of an effective position management system. 

32. Staff elements, such as budget, manpower utilization, management analysis, 
and personnel, should all assist the manager to implement an effective position 
management program. 

33. Behavioral science applications to job design is an important consideration 
in position management. 

34. Minor duties are typically those duties that are; 

a. performed at recurring intervals. 

b. significant in determining qualification requirements. 

c. not significant for classification purposes. 

d. projected duties not presently being performed. 

35. The "journeyman concept," in connection with positions subject to the 
Classification Act: 

a. should be avoided because it constitutes mechanical classification. 

b. means that for every kind of work there is a generally recognized 
full performance level. 

c. assumes that the level is the same for all series in which a Journey man 
level can be discerned. 

d. can be used to establish a convenient landmark in classifying positions 
in certain occupations. 
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36. Which one of the following Is not generally a way to resolve the 
appropriate series for a mixed series position: 

a. use of a mixed grade series. 

b. use of combination or "catchall" series. 

c. use of general series. 

d. use of dominant series. 

37. One of the following groups of conditions describes most accurately 
the characteristics of a class of positions: 

a. same descriptive titles, same kind of work, same level of difficulty 
and responsibility, same qualification requirements . 

b. same compensation, same descriptive title, same kind of work, same 
level of difficulty. 

c. same level of work, same kind of work, same organizational unit, 
same range of compensation. 

d. same kind of work, same level of difficulty, same qualifications 
requirements, same supervisory or nonsupervisory responsibilities. 

38. Which one of the following is not a primary objective of the Federal 
classification plan: 

a. Pay shall be based on the principle of equal pay for substantially 
equal work. 

b. Classification of positions shall be based on duties, responsibilities, 
and qualification requirements . 

c. Grades 16, 17, and 18 shall be classified by the Civil Service 
Commission. 

d. The position classification plan should facilitate all phases of 
personnel administration. 

39. An example of a "new factor" used in classification standards is: 

a. Purpose and Nature of Person-to-Person Work Relationship. 

b. Nature of Supervision Received by Incumbent. 

c. Qualifications and Scientific Contributions. 

d. Nature and Variety of Wbrk. 

40. Usually, the most difficult step in classifying a position is: 

a. detecmining whether it is under the Classification Act. 

b. determining the series. 

c. determining the grade. 

d. determining the appropriate standard. 
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41. A position involves the following combination of work: 10% filing, 

GS-305-2; 15% stenography, GS-312-4; 25% general office clerical, GS-301-4; 
and 50% personnel clerical, GS-203-5. Its proper classification is: 

a. Personnel Clerk, GS-203-4. 

b. Personnel Clerk (Stenography), GS-203-5. 

c. Personnel Clerk (Stenographer)., GS-203-5. 

d. Administrative Clerk (Personnel), GS-203-5. 

42. A temporary position is classified to the same class as: 

a. other temporary positions paid for from the same funds. 

b. other temporary positions established for the same length of time. 

c. permanent positions paid for from the same funds. 

d. permanent positions with similar duties and responsibilities. 

^ • The Civil Service Commission's standard of adequacy provides that a 
position description is adequate if it states: 

a. principal duties, responsibilities, and supervisory relationships. 

b. introduction, duties, supervision received, and other significant 
facts. 

c. organizational information, principal duties, and principal 
responsibilities. 

^ * principal duties, responsibilities, and qualification requirements. 

44. Secondary sources of facts about positions for classification purposes are: 

a. mission statements, technical manuals, and the desk audit. 

b. position description files, mission statements, and shop talk. 

c. reports, organizational charts, and the supervisor. 

d. work samples, organizational charts, and reports. 

45. Advantage(s) to management offered by a classification plan include: 

a. a uniform titling practice. 

b. a basis for statistical information. 

c. assistance in organizational planning. 

d. all of the above. 

46. Disagreements as to facts or conflicting statements about positions: 

a. require resolution by responsible management prior to classification 
of the position. 

b. require no classifier action if the position description has been 
signed by both the supervisor and the employee. 

c. may be ordinarily resolved on the basis of the official records of the 
organization without referral to management. 

d. should be referred directly to the head of the agency for resolution 

since the original delegation of classification authority was made 
to him. 



ERIC 




18 - 



6 



47. The one factor which is most closely related to determination of the 
kind of work is: 

a. supervisory control exercised over the work. 

b. availability of guidelines. 

c. originality of thinking required. 

d. qualification requirements of . the work. 

48. In conducting most classification interviews, it usually is best to: 

a. make arrangements to interview the employee at a location where he 
won't be interrupted by the normal work operations. 

b. interview the employee at his desk, in his shop, or other location 
where he normally performs his work. 

c. discuss the employee's position with him over the telephone. 

d. call the employee to the Classification Office where he can speak 
privately and without possible Interference from his supervisor. 

49. In the Coordinated Federal Wage System the factor of "Responsibility" 
used in grading nonsupervisory jobs covers: 

a * practical knowledge of the principles underlying the work. 

b. complexity of work. 

c. physical effort related to movements of the body. 

d. hazards Involved in working with explosives or toxic materials. 

50. Which of the following is not a position management goal: 

a. e laminate unnecessary positions. 

b. achieve efficient, productive operations. 

c. design position structures so they will tap available skills in the 
labor market. 

d. downgrade positions. 
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Attachment 3 



TEST ITEM DISTRIBUTION 
FOR 50- ITEM OBJECTIVE PRE-TEST & POST- TEST 



Position Classification 

1 . Terminology 

2. Basic legislation 

3. Structure of the system 

4. Methodology, techniques, 
and procedures 

5. General policy and philosophy 
of the system 

6. Trends in the field 

7 . Principles 

Wage System 

15# Terminology 

16. Basic authority 

17. Structure of the system 

18. General policy and philosophy 
of the system 



POSITION WAGE POSITION 

CLASSIFICATION SYSTEM MANAGEMENT 



80% (40) 10% (5) 10% (5) 

6 
1 
3 

10 

5 

10 



2 

1 

1 

1 



2 

1 

2 



Position Management 

20. General policy and philosophy 
of the system 

21. Basic authority 

22. Principles 
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Attachment 4 



SELF-ASSESSMENT QUES TIONNAIRE 

This is a self -assessment questionnaire and me will ask you to complete 
this before and after the course. The elements listed will be covered 
in the course. We mould like your reaction to the importance of each 
element for successful performance of your job and what you feel to be 
your present level of understanding or skill on each element. 

Please indicate beside each element the importance of the element for 
successful performance of your job by marking in the appropriate box: 

- if that element is of no importance or if only minor importance 

o if that element is of some importance but not essential 

« 

+ if that element is essential to effective performance 

In addition, please circle a number value on the scale beside each 
element which test indicates the understanding or skill you feel you 
presently possess. You may circle any number on the scale. The 
scale is as follows: 



No understanding Moderate understanding Completely 

or skill or skill adequate 




Understanding is evidenced by the ability to define, describe or cite 
the major aspects of the element. 

Skill m .& evidenced by the ability to apply the major aspect of the 
element. 

In addition to the questionnaire, please answer the following: 

Do you presently have classification responsibilities / / / / 

Yes No 
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III. Understanding of the following 
fundamentals of the Wage System : 
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Attachment 5 



TRAINING WORK PRODUCT RATING SCALE 

Training work products will be rated against the school solution 
using the following scale: 

5 * Excellent - considerably better than average 
4 - Good - better than average 
3 - average - acceptable 
2 - Below average - needs some improvement 
1 - Poor - needs a great deal of improvement 
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Attachment 6 



NAME_ 

STUDENT WORK SHEET FOR EVALUATION OF POSITIONS 
RECOMMENDED CLASSIFICATION 

TITLE SERIES GRADE 



Brief Statement of Rationale for Recommended Classification: 



CHECKLIST FOR DESK AUDIT NAME of Auditor 
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Attachment 8 



EVALUATION OF SPECIFIC CONTENT IT&S 

Please indicate your reaction to the amount of coverage 
devoted to each of the following program items: 
(check the appropriate column) 



Program Item 
Position Classification: 
1 • Terminology 


Too Little 

» 

i 


Too Much 


j *22H£ Mi &k 


2. Basic legislation 








3. Structure of the System 








4* Methodology, Techniques 
and Procedures. 


» 






5. General Policy and 

Philosophy of the System 


• 






6. Trends in the Field 






! 


7, Principles 








S. Desk Audit 








9. analysis of Position 
Classification Standards 








10. Analysis of Job Information 








11. Evaluation of Positions 








12. Writing of Position 
Descriptions 








13* Writing of Evaluation 
Statements 








14* Dealing Effectively with 
Line Officials and 
Employees 








'MBS. System 
15. Terminology 






• 

i 


16. Basic Authority 








17. Structure of the System 




i 

L l 


IS. General Policy and 

Philosophy of the System 






I 

i 

l 


19. Evaluation of Positions 








Position Management 

20. General Policy and 

Philosophy of the System 




r 


— f 


21. Basic Authority 


J 


I ] 




22. Principles j 
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Attachment 9 



EVALUATION OF RESOURCES , METHODS AND MATERIALS 
Please indicate your reaction to the following: 



i. Pre-course assignments 


Too Little 


Too Much 


About Riaht 


2. Civil Service Gommission 
instructors and lecturers 








3* Non- Civil Service Commission 
instructors and lecturers 








4. Length of presentations 








5. Opportunity for discussion 








6. Workshops 








7. Evening asslgnmehts 








8* Handout materials 








9. Visual and related aids 








10. Breaks 


* 






11. Length of course 














NAME 



Attachment 10 



EVALU ATION OF INSTRUCTOR OR DISCUSSION LEADER 

Instructor 



Session Title 



Please put a circle around the number on the scale ut the right which 
best represents your opinion of the leader's performance* 



Scale of Rating 

5 • Excellent (well above average) 

4 - Good (better than average) 

3 - Average (acceptable) 

2 - Below average (needs some improvement) 

1 - Poor (needs a great deal of improvement) 



Evaluation 



1. 


Was prepared for presentation 


l 


2 


3 


4 


5 


2. 


Knew his subject 


1 


2 


3 


4 


5 


3. 


Covered the subject adequately 


1 


2 


3 


4 


5 


4. 


Expressed his ideas clearlyjand simply 


1 


2 


3 


4 


5 


5. 


Used concrete, practical illustrations 


l 


2 


3 


4 


5 


6 . 


Used instruction aids effectively 


1 


2 


3 


4 


5 


7. 


Spoke clearly and distinctly 

» * ' 


1 


2 


3 


4 


5 


8. 


Held the Interest of the group 


1 


2 


3 


4 


5 


9. 


Involved the group 


1 


2 


3 


4 


5 


10. 


Motivated the group 


1 


2 


* 


4 


5 


11 . 


Helped the group to apply his material 


1 


2 


3 


4 


5 


12. 


Summarized his presentation 


l 


2 


3 


L 


* 
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Attachment 11 



EVALUATION OF, ENVIRONMENTAL Eg&SBBBS 
Please indicate your reaction to the following questions: YES NO 



1. "as the room Drooerly lighted? 






2. Wa3 the room oroDerly heated? 






3. v.'as the room oroDerly ventilated? 






4. Did the room location avoid outside noise and other 
distractions? 






5. Were the seats comfortable? 






6. Gould the participants sea wall? 






Gould the participants hear well? 







7. How could the physical setting or arrangements be improved? 
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SUMMARY AND ANALYSIS OF EVALUATION DATA 



A. Fifty -item AOd fifty -item post- test . These 

instruments are designed to measure the knowledge level 
of the participant as he enters the course and also 
at the end of the course. The post -test is an alternate 
version of the pre-test. 



1 • Findings 



PRE-TEST 
Range Median 
(right answers) 



POST-TEST 
Range Median 
(right answers) 



Training group 29-41 34 

Developmental group 25-41 33 



32- 43 38 

33- 49 41 



2. Analysis of findings. Hie results indicate an increase 
of knowledge for both groups. The percentage increase 
for the training group is 8% and for the development 
group 16%. Our stated acceptable level of performance 
for the post- test was 90% (45 right answers). This 
goal was not met and appears to be unrealistic. 



The pre-test is used primarily to establish base line 
data for post-test comparison, but it is also valuable as a 
diagnostic tool in assessing individual students. Used 
for both purposes, the pre-test/post- test design for 
knowledge objectives is a valuable evaluation instrument. 



B. Pre/Post assessment questionnaire bv learner and supervisor . 
These instruments are designed to measure the participants 
and supervisor *s perception of the importance of the course's 
knowledge and skill objectives for successful performance of 
the learner's job, and to measure their perception of the 
learner's knowledge and skill level before and after the course. 



The scale for rating the importance of the objectives for 
successful job performance is as follows: 

- if that element is of no importance or of only 
minor importance 

o if that element is of some importance but not 
essential 

+ if that element is essential to effective performance 



- 35 - 



3 ? 



The scale for indicating the learner's knowledge or skill 
level is as follows: 



No understanding 
i or skill 



t — i — r 



Moderate understanding 
or skill 

* 

-? — s — r 



1 5 5 



Completely 

Adequate 

4 



1. Findings: A summary o£ the findings is as follows: 



a. Training group 



LEARNER 



SUPERVISOR 



Importance Number Importance Humber 



to job 



value 

Pre/Post 



Knowledge of position 
classification 

Skill in position 
classification 

Knowledge of wage 
system 

Skill in wage system 

Knowledge of position 
management 



b. Developmental group 



0 

0 



4 

2 



5 

5 



LEARNER 

Importance Number 
to job value 

Pre/Post 



to job 



value 

Pre/Post 



0 

+ 



4 

2 



5 

6 



SUPERVISOR 
Importance Number 
to job value 

Pre/Post 



Knowledge of position 
classification 

Skill in position 
classification 

Knowledge of wage 
system 

Skill in wage system 

Knowledge of position 
management 



2. A detailed listing of findings is as follows: 
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13 . Siting of Evaluation Statements 
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13. -Viting of Evaluation Statements 
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2. Analysis of findings 



a. Importance of elements for successful job performance 

Knowledge of position classification and skill in position 
classification were considered essential for effective job 
performance by supervisors and learners in both the 
training group and the developmental group. This confirms 
our assumptions about the importance of these elements for 
both groups and reinforces our decision to continue to accept 
a heterogeneous group of learners. In addition , it tends to 

support our decision to devote 80% of the course to these 
two general objectives. 

Knowledge of the wage system, skill in the wage system, 
and knowledge of position management are generally 
considered, by both the learner and the supervisor, of 
some importance but not essential for successful job 
performance for both groups. There are two exceptions: 
knowledge of the wage system is considered essential to 
effective job performance by the learners in the developmental 
group; and skill in the wage system and knowledge of position 
management are considered essential to effective job 
performance by supervisors of the training group. 

The above reinforced our decision to introduce the wage 
system and position management in the course but not to 
emphasize these topics. The wage system constitutes 10% 
of the course and position management constitutes another 
10%. Position management is emphasized in other training 
courses offered by the Personnel Management Training Center, 
and in fact is the subject of one three-day course. 

b. Pre/Post number value assessment for each element 

Supervisors of both groups, and learners, indicated almost 
identical ratings on both pre- and post assessments. This 
seems to indicate an accurate perception of where the 
learner began and where he ended in terms of the learning 
experience. 

The developmental group rated lower than the training group 
on all pre -assessment elements by both learner and supervisor 
but tended to rate about the same as the training group on 
pos t-assessment . 
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The actual point value increased in all areas. The 
greatest increases were in the area of: knowledge of 

the wage system* skill in the wage system, and knowledge 
of position management. Both group entered with "little or 
no knowledge" and left with "moderate knowledge or skill." 
The actual point values could be turned into percentages 
but this is not too meaningful since these number values 
are only perceptions. 

The most difficult data to collect was the post assessment 
data from supervisors. Several supervisors indicated that 
they could not complete the post-assessment for a variety 
of reasons which included: 

- employee assigned to a personnel functional area 
other than position classification 

- difficult to measure the effect of a one -week training 
course on actual change in job behavior 

- not enough time after completion of the course to 
effectively measure any change in behavior. (The 
post-assessment questionnaire was rent to supervisors 
three weeks after the completion of the course.) 

% 

3. Training work products 

a. Training work products are evaluated against school 
solutions using the following scale: 

5 - Excellent - considerably better than average 

4 - Good - better than average 

3 - Average - acceptable 

2 - Below average - needs some improvement 

1 - Poor - needs a great deal of improvement 

N/C • Not complete 

b. Training work products included: 
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Trng. Devmntl. 

group group 

median 

(1) Findings 

(a) Written analysis o£ 
standards 

- clerk-typist, 6S-322 5 5 

- payroll clerk, GS-544 5 5 

(b) Written classification of 
positions 

- clerk- typist 

- payroll clerk 

- mixed-series, mixed- 
grade (clerical) 

- supervisor position 
(Part I) 

- supervisory position 
(Part II) 

- engineer position 

(c) Writing of position 
descriptions 

- P.b. #1 pre-test 

- P.D. #1 post- test 

- P.D. #2 

(2) Analysis of findings 

Training work products are designed to simulate the 
actual job situation of the position work classifier. 
The majority of all training products were acceptable. 
This is the best evaluation technique for measuring 
the application of knowledge of the skill objectives. 
This technique provided continuous feedback to both 
the instructor and the students. 

Practice desk audit 

The checklist is designed to evaluate the participant's skill 
in a role-play desk audit. Participants are evaluated by 
their peers. 




a. Findings 

Median 

Training group 5 

Developmental group 5 

b. Analysis of findings 

This instrument has as its major value ,, feedback M to the 
participant. The "desk, audit" is a difficult task to 
simulate because of the many variables involved in the 
real situation. 

Evaluation of specific content items 

This instrument is designed as a reaction checklist. The 
participants are asked to indicate the amount of coverage 
devoted to each of the program objectives in terms of "too 
little, 11 ,f too much," n ebout right. M 

a. Findings 

The majority of the participants checked all items 
"too little." 

b. Analysis of findings 

Participants felt that more time should have been spent on 
all items and that the course should have been longer. 

Evaluation of resources, methods, and materials 

This instrument is designed as a reaction checklist. The par- 
ticipants are asked to react to a number of items in terms of 
"too little," "too much," "abtut right." 

a. Findings 

The majority of participants checked all items "too little," 

with the exception of evening assignments which was checked 
"too much." 

b. Analysis of findings 

Some participants resented recurring evening ‘assignments. 
However, evening assignments are an important part of the 
program, and this requirement will be emphasized to the 
pdrticipfints b6for6 the progroin begins. 
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Evaluation of instructors or discussion leaders 



This instrument is designed as a reaction checklist. .he: 
participants are asked to indicate their reaction to a number 
of items on each instructor immediately after each presentation. 

a. Findings 

The majority of participants rated all instructors "good” 
or "excellent" on the majority of items. 

b. Analysis of findings 

This instrument proved valuable to each instructor. It 
gave him information immediately after his presentation 
which was helpful in correcting weak aspects and in 
providing ego satisfaction for the good aspects. The use 
of this instrument improved the quality of instruction 
by simply requiring instructors to put greater effort 
into preparation. 

8. Evaluation of environmental features 

This instrument is designed as a reaction checklist. Parti- 
cipants are asked to respond to a number of questions by 
answering "yes" or "no." 

a. Findings 

A number of reactions indicated that the room was not 
properly heated* ventilated* or free from outside noise. 

b. Analysis of findings 

This information is helpful and will be used to try to 
improve future classroom situations. 

9. Oral critique by participants at end of program 
a. Findings 

Overall reaction indicated that the course was very good* 
but there was a strong negative reaction to the evaluation 
phase of the program. They felt that too much time had 
been devoted to evaluation and that the constant require- 
ments for evaluation were "oppressive." 
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b. Analysis of findings 



The constant evaluation imposed a great deal of pressure 
on the participants and a reverse "Hawthorne effect" was 
reflected in the oral critique. This feeling will be 
taken into account in presenting the next program, and the 
instructors will attempt to lessen the pressure that 
evaluation tends to create. 



XX. Conclusions 

The design and application of this model resulted in modification 
and improvement of the training program. The strengths of the model 
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- provides data on the students as they enter the course; this is an 
absolute necessity for evaluation 

- identifies specific training needs for the actual group of 
participants 

- provides specific data on individual participants which is an 
excellent diagnostic tool for the instructor 

- provides immediate and continuous feedback to the instructors 
and the participants. 

The limitations of the model are: 

it is time-consuming to design and administer 

- there is a large amount of time devoted to tabulating data 

' it: does not appear to be effective in measuring application of 
knowledge and skill back on the job 

- it does not attempt to measure attitudes. 

The above strengths outweigh the limitations. The design of this 

model has applicability to other training programs conducted by the 

Personnel Management Training Center. 

X. Recommendations 



The next Position Classification and the Management Process course 
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are: 




